An axiomatization of partition entropy
نویسندگان
چکیده
The aim of this paper is to present an axiomatization of a generalization of Shannon’s entropy starting from partitions of finite sets. The proposed axiomatization yields as special cases the Havrda-Charvat entropy, and thus, provides axiomatizations for the Shannon entropy, the Gini index, and for other types of entropy used in classification and data mining. Keywords—Shannon entropy, Gini index, Havrda-Charvat entropy, non-Shannon entropy.
منابع مشابه
A local approach to the entropy of countable fuzzy partitions
This paper denes and investigates the ergodic proper-ties of the entropy of a countable partition of a fuzzy dynamical sys-tem at different points of the state space. It ultimately introducesthe local fuzzy entropy of a fuzzy dynamical system and proves itto be an isomorphism invariant.
متن کاملAn axiomatization of entropy of capacities on set systems
We present an axiomatization of the entropy of capacities defined on set systems which are not necessarily the whole power set, but satisfy a condition of regularity. This entropy encompasses the definition of Marichal and Roubens for the entropy of capacities. Its axiomatization is in the spirit of the one of Faddeev for the classical Shannon entropy. In addition, we present also an axiomatiza...
متن کاملTsallis Entropy and Conditional Tsallis Entropy of Fuzzy Partitions
The purpose of this study is to define the concepts of Tsallis entropy and conditional Tsallis entropy of fuzzy partitions and to obtain some results concerning this kind entropy. We show that the Tsallis entropy of fuzzy partitions has the subadditivity and concavity properties. We study this information measure under the refinement and zero mode subset relations. We check the chain rules for ...
متن کاملNotes on evolution of axiomatic characterization of the Tsallis entropy
The Tsallis entropy was proposed as a possible generalization of the standard Boltzmann-Gibbs-Shannon (BGS) entropy as a concept aimed at efficient characterisation of non-extensive complex systems. Ever since its introduction [1], it has been successfully applied in various fields [2]. In parallel, there have been numerous attempts to provide its formal derivation from an axiomatic foundation,...
متن کاملSimple axiomatization of reticulations on residuated lattices
We give a simple and independent axiomatization of reticulations on residuated lattices, which were axiomatized by five conditions in [C. Mureşan, The reticulation of a residuated lattice, Bull. Math. Soc. Sci. Math. Roumanie 51 (2008), no. 1, 47--65]. Moreover, we show that reticulations can be considered as lattice homomorphisms between residuated lattices and b...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- IEEE Trans. Information Theory
دوره 48 شماره
صفحات -
تاریخ انتشار 2002